Papers by José María Millet Pascual-Leone
WorldMedQA-V: a multilingual, multimodal medical examination dataset for multimodal language models evaluation (2025.findings-naacl)
Copied to clipboard
João Matos, Shan Chen, Siena Kathleen V. Placino, Yingya Li, Juan Carlos Climent Pardo, Daphna Idan, Takeshi Tohyama, David Restrepo, Luis Filipe Nakayama, José María Millet Pascual-Leone, Guergana K Savova, Hugo Aerts, Leo Anthony Celi, An-Kwok Ian Wong, Danielle Bitterman, Jack Gallifant
| Challenge: | Existing multiple-choice question and answer (QA) datasets are text-only and available in a limited subset of languages and countries. |
| Approach: | They propose a multilingual, multimodal benchmarking dataset to evaluate multimodal/vision language models in healthcare. |
| Outcome: | The WorldMedQA-V includes 568 labeled multiple-choice QAs paired with 568 medical images from four countries. |